INTERSECTION OF HARMONICS AND CAPELLI IDENTITIES 

FOR SYMMETRIC PAIRS 
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Abstract. We consider a see-saw pair consisting of a Hermitian symmetric pair 
(Grj-Kr) and a compact symmetric pair (Mr,Hr), where (Gr, Hr) and (K^, Mr) 
form a real reductive dual pair in a large symplectic group. In this setting, we 
get Capelli identities which explicitly represent certain iTc-invariant elements in 
U (qc) in terms of TJc-invariant elements in U (mc). The corresponding _ffc-invariant 
elements are called Capelli elements. 

We also give a decomposition of the intersection of 02n-harmonics and Sp 2n - 
harmonics as a module of GL„ = 02 n H Sp 2 „, and construct a basis for the GL„ 
highest weight vectors. This intersection is in the kernel of our Capelli elements. 



Introduction 

Consider a see-saw pair of real reductive Lie groups in the real symplectic group 

Sp 2iV (K), 

G M 
U x U 
K H , 

where both (G , H ) and (K , M ) are dual pairs (cf. [How2, (5.1)]). Recall that the 
pair (Go, Ho) is a dual pair if Go and Ho are the mutual commutants of each other 
in Sp 27V (IR). Let q be the Lie algebra of G and g its complexification. We use the 
same notation for the other Lie groups. 

The symplectic group Sp 27V (IR) has the unique non-trivial double cover Mp 2JV (R), 
which is called a metaplectic group. It has a unique unitary representation uj called 
the Weil representation (or the oscillator representation; see [How2] or [KV], for 
example). We use the same symbol u to denote the differentiated action on the 
Harish- Chandra module of u. Thus uj is a representation of the complexified Lie 
algebra sp 2N of Sp 2iV (IR). The Harish-Chandra module can be explicitly realized 
as the the polynomial ring on the N- dimensional vector space V ~ C N (see [How2, 
p. 537]). In this realization, elements of sp 2 ^ act by polynomial coefficient differential 
operators on V. According to the result of Howe ([Howl]), we have the following 
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equation of the algebras of differential operators: 

u(U(g) K )=u;(U(m) H ), 



(0.1) 



where K and H denote the complexifications of K and H respectively, and U(g) K 
denotes the set of ^-invariants in the universal enveloping algebra U(g). 

Let g = t © p be the complexified Cartan decomposition. The subalgebra S(p) K 
of the .fT-invariants in the symmetric algebra S(p) is isomorphic to a polynomial ring 
(see [KR]), and let X ± ,X 2 , ... ,X r be a set of homogeneous generators of S(p) K . If 
i : S(p) — > U(g) is a i^-linear pseudo-symmetrization map (for the definition, see 
§ 1.1), then the image i(X d ) is ^-invariant and hence ui(i(X d )) can be expressed in 
terms of uj{U[m) H ) thanks to (0.1): 



We call this formula a Capelli identity for a symmetric pair and C d the Capelli element 
corresponding to X d . In fact, the identity gives a relation between differential oper- 
ators in various kind of determinantal form, which is similar to the original Capelli 
identity ([Cap]). However, our Capelli elements are not central in the enveloping 
algebra, and they depend on the choice of the pseudo-symmetrization map i. Despite 
this, the Capelli elements in this paper resemble the original Capelli element (ibid.) 
or its variants (see [HU], [Ito], [Naz], [MN], [Osh] and [Wac], for example). 

We give explicit forms of the Capelli elements for the see-saw pair, where G /K 
is an irreducible Hermitian symmetric space, and M is compact. The main results 
are summarized in Theorems 2.1, 2.6 and 2.7 respectively. 

Our Capelli identities are closely related to the (pluri-) Harmonic polynomials for 
compact classical Lie groups. In fact, if we consider the orthogonal group 02 W (M) and 
the unitary symplectic group USp 2n in U 2 „, it turns out that the harmonic polynomials 
are annihilated by Capelli elements (§ 3.5). Thus the joint harmonics for 2 „ and 
USp 2ri are in the kernel of different kinds of Capelli elements, which are written as 
an element of the enveloping algebra of U 2ri in determinantal form. 

We are interested in the kernel of the Capelli elements. However, we have not found 
a good characterization via representation theory. Instead, we study the intersection 
of harmonics for 02 n and Sp 2ri . Note that the joint harmonics carries a representation 
of GL„ = 02 n nSp 2n . In Theorem 3.1, we give a decomposition of the joint harmonics 
as a GL„-module in terms of the Littlewood-Richardson coefficients. We also indicate 
how a basis for the space of GL n highest weight vectors can be obtained in §4. This 
is related to the tensor product algebras constructed in [HTW] (see also [HL]). 

As a result of our study of joint harmonics, we can answer the following problem, 
which is of independent interest. Let p\ n be an irreducible finite dimensional repre- 
sentation of GL 2ri with the highest weight A = (Ai, A2, • • • , A&, 0, . . . , 0) (k < n/2). 
Let us consider the subrepresentation of 02 n (respectively Sp 2n ) generated by the 
highest weight vector of p 2ri , and denote it by <x 2n (respectively by r^J. Then we 
can identify the intersection <r 2n n r 2n as a subspace of joint harmonics, and we get a 
decomposition as a representation of GL n = 2 „ fl Sp 2n : 



u(t{X d )) = u(C d ) 



(C d e U(m) H ). 



< n r 2 A n ~ 



e 
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where is the Littlewood-Richardson coefficients, Vk is the set of partitions with 
length < k, and p v is given in (0.3) below. From this, we conclude that the 
intersection is in the kernel of Capelli elements, which is not easy to see a priori. 

Acknowledgment. The first named author expresses his sincere gratitude to Kyoto 
University for warm hospitality during his visit in the summer of 2005. 

Notation for finite dimensional irreducible representations. Let us fix the no- 
tation for irreducible finite dimensional representations of the complex matrix groups 
GL n , 2n and Sp 2n . 

Let A = (Ax, ... , A n ) 6 Z" be a dominant integral weight for GL n , i.e., Ax > A 2 > 
• • • > A n . We denote by p\ the irreducible finite dimensional representation of GL n 
with highest weight A. Similarly, if A n > 0, we denote by <r 2n (respectively T 2n ) the 
irreducible finite dimensional representation of 2n (respectively Sp 2n ) with highest 
weight A. We define A* = — (A n , A n _x, . . . , Ax), which is the highest weight for the 
contragredient representation (p*)*- Let 

V n = {A = (Ax, . . . , A n ) e Z> | Ai > A 2 > • • • > A n > 0} (0.2) 

be the set of partitions of length < n. We denote the length of a partition A by £(X). 
Take two partitions p E V p and v e V q (p + q < n). Then we denote 

pQu = (/i, 0, . . . , 0, z/*) 

= p 2 , ■ ■ ■ , Hp, 0, . . . , 0, -u q , -is q -i, . . • , -vi) e Z n , 

which is a dominant integral weight for GL n . 

I. Capelli identities for symmetric pairs 

1.1. Pseudo-symmetrization map. Let Go be a real reductive Lie group, and Kq 
its maximal compact subgroup. We denote by g and t the complexified Lie algebra 
of G and K respectively. 

Let U (g) be the enveloping algebra of g, and denote by FiU (g) the standard filtra- 
tion of U(g). For the symmetric algebra 5(g), we have the direct sum decomposition 
by the standard grading S(g) = (& i>0 Si(g). Then there is a natural grading map 
gr; : FiU(g) -> Si(g) with the kernel Fi_iU(g). 

Let g = t © p be the complexified Cartan decomposition. If a i^-linear map 
i : S(p) — > U(g) satisfies gr^^u)) = u for every homogeneous element u E S'j(p), we 
call i a pseudo-symmetrization map. 

There are two basic examples of pseudo-symmetrization maps. First, the full sym- 
metrization map 

y<Yt. ■■■Y d ^ (i/d!) Y °m Y *m ■ ■ ■ Y °ii) ( Y i G P)- 

Second, when (g, fi) is of Hermitian symmetric type, we have the irreducible decom- 
position p = p + © p~ as i^-modules. In this case, 

c:S(p) - U(g) 

uiu 2 h-> uiu 2 (ui G U(p + ),u 2 E U(p )) y ' } 
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is a pseudo-symmetrization map, since both p + and p _ are .ff -stable abelian Lie 
algebras. 

1.2. Abstract Capelli identity for see-saw pairs. As in the introduction, con- 
sider a see-saw pair of real reductive Lie groups in the real symplectic group Sp 2A r(R), 

U x U 

where both (Go, H ) and (K , M ) are dual pairs. Let u be the Harish- Chandra mod- 
ule of the Weil representation, realized as polynomial coefficient differential operators 
on the iV-dimensional vector space V ~ C N . Due to Howe, we have the following 
identity of algebras of polynomial differential operators: 

cu(U(g) K )=cu(U( m ) H ), (1.2) 

where K and H denote the complexifications of Kq and Ho respectively. 

Let g = t ©p be the complexified Cartan decomposition. The subalgebra S(p) K of 
the i^-invariants in the symmetric algebra S(p) is isomorphic to a polynomial ring, 
and let X 1: X 2 , . . . , X r be a set of homogeneous generators of S(p) K . Choose a K- 
equivariant pseudo-symmetrization map i : S(p) — > U(g). Then the image t(X d ) is 
.fT-invariant and hence oj(i(X d )) can be expressed in terms of u(U(m) H ) thanks to 
Equation (1.2): 

co(i(X d )) = cu(C d ) (C d e U(m) H ). (1.3) 

We call this formula a Capelli identity for a symmetric pair and C d the Capelli 
element corresponding to X d . Note that our Capelli elements are not central and 
they depend on the choice of the pseudo-symmetrization map i. Even if we fix the 
map i, the Capelli element C d is not uniquely determined in general because the 
Weil representation u has a non-trivial kernel. However, if M is relatively small by 
comparison with K, it is uniquely determined. 

2. Capelli identities for symmetric pairs of Hermitian type 

Let us assume that (g, t) is of Hermitian symmetric type, and take a pseudo- 
symmetrization map l as in (1.1). There are three of such (irreducible) see-saw pairs 
given in Table 2 (see [How2]). Note that (M , H ) is also a symmetric pair in all the 
three cases. 

Table 1. see-saw pairs with G Hermitian type, M compact 

Sp 2N (R) G K Mo H 

CaseR Sp 2k(p+q) (R) Sp 2fc (R) U fc U n O n 

Case C Sp 2(p+?)(r+s) (R) U M U p xU, U B xU„ U n 
CaseH Sp 4fe(p+(?) (R) 0* 2k U fe U 2n USp n 



HARMONICS AND CAPELLI IDENTITIES 5 

In the subsequent subsections, we will give explicit form of the Capelli elements for 
these three cases. Thus we have identities of differential operators in the expression 
of various minor determinants, which is of independent interest. 

We note that we can give the Capelli identities also for the cases where M is non- 
compact by using the Fourier transform, although we do not describe them in this 
note. We thank Hiroyuki Ochiai and Jiro Sekiguchi for pointing out it to us. 

2.1. Case R. In this subsection, we give the Capelli identity for the symmetric pair 
of Case R. We first fix the notation and describe the generators of S(p) K to state the 
main theorem. For Case R, a complex Lie algebra q and its subalgebras t and p^ 1 are 
explicitly given as follows. 

= «P» = {(£ 3h) I G,F%m k }> P+ = {(o o) G0 }' 

*={(o X) G s}" 0[fc ' P ~ = {(f o) G0 }' 

Hij = Eij — Ek+j t k+i G Gij = Ei^+j + Ej y k+i G p + , F^ = E^+ij + Ek+j t i G p , 

where E^ denotes the matrix unit with 1 at its (i,j)-th position and elsewhere, and 
Sym fe = Sym fc (C) the set of the complex symmetric k x k matrices. The complex Lie 
algebra m and its subalgebra f) are given by 

m = gl n , i ) = 0n = {X egl n ; t X + X = O n }. 

Let V = M„ )fe (C) be the space of n x k matrices and denote the linear coordinate 
functions on V and the corresponding differential operators by 

x S i, d S i (1 < s < n, 1 < i < k). 

Let s = sp 2kn be the complex symplectic Lie algebra, in which both (jj, h) and (t, m) 
form dual pairs. We have (the Harish-Chandra module of) the Weil representation 
uj of s on the space C[V] of polynomial functions on V. The explicit representation 
operators of jj and m are given as follows: 

n 

Ld (Gij ) = V^T ^ X si X sj , V {Fij ) 

s=l 

n 
s=l 

We now recall the structure of S(p) K . Since $j is of Hermitian type, K ~ GLfc(C) 
acts multiplicity-freely both on the symmetric algebra 5*(p + ) and on 5'(p _ ). 



^(P + ) = ©, GPfc W » = © 




Thus we have the expression of S(p) K , 

s(p) K = (s(p+) ® c s(p-)) K = (w, ® c w;) 



= V^T^dsidsj, 

k 3=1 k (2-1) 
— %sidti + — S st . 
1=1 



6 SOO TECK LEE, KYO NISHIYAMA, AND AKIHITO WACHI 

which is isomorphic to a polynomial ring with k algebraically independent generators. 
For d — 1, 2, ... k, the d-th generator is the basis vector of the one-dimensional vector 
space (W^ ® c W*) K for fj, = (2, . . . , 2, 0, . . . , 0) = {2 d , k ~ d ). The explicit form of the 
generators are 

X ^= det G u ■ det Fjj e S(p) K (d = 1, 2, . . . , k; fc = r), (2.2) 

/,JGX d fc 

where X d is the index set defined by 

X k d = {I C{l,2,...,fc}|#/ = d}, (2.3) 

and G/j denotes the dxd submatrix of the fc x k matrix (Cry) with the rows and the 
columns chosen from / and J respectively. Note that the generators above belong 
to the symmetric algebra S(p), and that and F^y appearing in the generators 
commute with each other in this context. 

We use i defined by (1.1) for the pseudo-symmetrization map. The images t(Xf) 
of the generators (2.2) of S(p) K look the same as themselves, except that the 
images are in U(q). In the following theorem, we use the column-determinant for the 
determinant of a matrix with non- commutative entries, defined by 

det(Zij) = ^ S g n (°") Z a{l)lZ a {2)2 ■ ■ ■ Z a ( d ) d . 

Theorem 2.1. For 1 < d < mm(k,n), we have the Capelli identities for the sym- 
metric pair of Case R: 

u( L (Xf))=u(Cf), (2.4) 
where Cf G U(m) H (d = l,2,...,n) are the Capelli elements defined by sums of 
products of two d x d minors with entries in U (m) : 

C^ = (-l) d £ det(E Sa , tb + (d-b-l-k/2)6 Sa , tb ) a , b 

s,T&J2 (2.5) 
x det{E SaA + {d-b-k/2)5 s 

where s a denotes an element of the index set S with si < s 2 < • • • < s d , and the 
similar rule applies to t b . Note that the identity is trivial when n < d < k since the 
right hand side becomes an empty sum. □ 

Note that (2.4) is in fact an identity of differential operators expressed explicitly 
by the formula (2.1). 

To prove Theorem 2.1, we demonstrate the computation for the commutative prin- 
cipal symbols. We first recall a basic lemma. 

Lemma 2.2 (Cauchy-Binet). Let R be a commutative ring and d < N. For a d x N 

matrix A e M^Ar(-R) with coefficients in R and N x d matrix B e M]y td (R), we have 

det AB = det A ;s det B s,„ 

sex" 

where A, jS is the d x d submatrix of A in which all the rows are chosen and the 
columns are chosen by S. □ 



HARMONICS AND CAPELLI IDENTITIES 7 

Define n x k matrices X and d by 

X = (x s i)i< s < n: l<j<fc, d = (<9 s i)l<s<n, l<i<fc- 

In the following computation we take the principal symbols, and we write the principal 
symbol of d si by the same letter d si . For /, J <E Z k Al the lemma above yields 

w(det(Gjj)) = det (v^TE^i ^^ J6 )i< a ,&<d 

= ( v / ^T) d det( t (X., / )X., J ) = (</=I) d fe)detX SJ . 

sei2 

Similarly we have 

cu(det(F J7 )) = (>/=!)" ^ det ^tj) det d TI , 

rex? 

and the equation of matrices 

w(E ST ) = (X^) ST (5,TeIJ), 

where Est = (-E , s ,t 6 )i<a,6<d is a matrix with coefficients in m. Note that the diagonal 
shift appearing in (2.1) vanishes here, since we are considering only the principal 
symbols. Note also that elements in the expressions above commute with each other 
for the same reason, and we have 

"(det G u ■ det F jr ) = (-l) d ^ ^ det det X SJ det t^j) det d TI 

= {-if det det(X*9) 5 Tdet9 T/ 

I,S,T 

(**) 



^ det(X*9) 5T det %X SI ) detd TI 



I,S,T 



(-l) d J2 det(X *9) 5 t det(X *9) 5 t 



(*) 

= (-l) d ^cu(detE 5T detE 5T ). (2.6) 

This is nothing but our desired formula in Theorem 2.1 except that there are no 
diagonal shifts in the last expression. The equalities with (*) and (**) do not hold 
when we do not take the principal symbols. We prove the non-commutative analogues 
of these two equalities with diagonal shifts in the following two lemmas. So from now 
on, d denotes the usual differential operator. 

Lemma 2.3. We have the following equation: 

E det X ^ ■ det d TJ = det(uj(E SaA + (d-b- k/2)5 SaA )) 1<ab<d . 

Proof. Since the right-hand side equals det(X^=i x Sa ,id tb ,i + {d - b)5 SaA )i< a ,b<d, this 
lemma reduces to the original Capelli identity ([Cap]). □ 
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Lemma 2.4. We have the following formula for ui, u 2 , ■ ■ ■ , e C: 
det X S i ■ det (£* =1 x SaA d tb ,i + u b 5 SaA ) ^ a ^ d 

= det(Eti^a,i^6,i + K - ty'afr)^^ ■ detX SI . 

Proof. For s e S, it is easy to see the commutator X^=i x S idu, det Xs/J is equal 

to 5 st detX5/. Since the determinant is multi-linear (in its column), we have the 
lemma. □ 

Proof of Theorem 2.1. From the first equality of (2.6), we have 

£ w(det Gjj ■ det F 7J ) = (-l) d ^ ^ det ^s/) det X SJ det t^j) det d TI . 

It follows from Lemma 2.3 that this is equal to 

(-l) d det X*si) det (u(E SaA + {d-b- k/2)5 SaA )) 

l<a,b<d 

I,S,T 

By Lemma 2.4, it turns out that the expression above equals 

{-l) d (u(E Sa , tb + (d-b-l- k/2)5 Sa , tb )\^ d • det \X S1 ) det d TI . 

I,S,T 

By using Lemma 2.3 again, this is equal to 

(-l^det (u(E Sa;tb + (d-b-l- k/2)5 Sa , b )) l ^ d 

S,T 

xdet (cv(E Sa!tb + (d-b-k/2)8 Sa , tb )) 

l<a,b<d ■ 

We have thus proved Theorem 2.1. □ 

We conclude this subsection by proving the iJ- invar iance of the Capelli element 
defined in (2.5). 

Proposition 2.5. The Capelli element is H -invariant, that is, G U(m) H , where 
H = O n is the complex orthogonal group. 

Proof. Consider an algebra of tensor products W = /\ C ra £g>c A ^ n ®c U (m) , which 
has a natural M-module structure; M = GL„ acts on the both C n by the dual of 
the natural representation (hence on its exterior product), and acts on U(m) by the 
adjoint action. Denote the standard basis of C n in the first and the second factor by 
{e t }t and {e' t } t respectively. Define r) t (u) and r)' t (u) in W by 

Vt(u) = E"=i e s(E s t + u5 st ), rj' t (u) = Y^=i e' s (E st + u5 st ). 

Note that we have for u, v G C and TgIJ, 

Vt(u) = ^2 e s det E ST («), r]' T (v) = e' s det E ST (v), 

Sei2 seis 

where 

Vt(u) = r} tl (u - l)?/^ (u - 2) • • • 77t d (u - d), e 5 = e Sl e S2 • • • e Sd 



HARMONICS AND CAPELLI IDENTITIES 9 

(the product is taken in the exterior power) and E 5T (w) denotes the d x d matrix 
whose (a, 6)-entry is E Sattb + (u — b)5 Saitb - Let Wd be the GL n -submodule of W spanned 
by {eTe' T/ \ T, T' G Then it is easy to check that the mapping 

A : W A -> W, e T e' T , ^ Vt(uWt>(v) (T, T' G 2J) 

is a GL n -homomorphism for w, t> G C, hence an O n -homomorphism in particular. 
Since the element X^T e T e T ^ ^ * s O n -invariant, Y2t VT{u)i] f T (v) is also O n -invariant. 

We define the contraction map e on by e(e T e' T ,) = 5t,t', which is naturally 
extended to W d ©c U(vci). Note that e is O n -equivariant. Now we conclude that 

£ {J2 T MuWAvj) = e (J2 TjS ,s> 6s det EsT ^ e 's' det E 5't(^)) 

= y2^ det E st(u) detE 5T (t;) 

is O n -invariant. □ 

2.2. Case C. In this subsection, we treat Case C. We realize Lie algebras g, t and 
p ± as given below, and define elements H-j\Fij, Gij of these algebras by 

'if W G \ if ^ G gl p , G G M P ,,(C) 
F ff^V H^e Q l q , FeM w (C) 



= flW? = 





G 








0^p © fllg, 

P _ = 




F 



ff 



(x) 



En g e 



G ? ; 



if 



(y) 



Ei, p +j G p 
Ep+ij G p 



[l<i<P,l<j <q), 
[l<i<q,l<j<p). 



(1 < i, j < p), 

E p+itP+j et (l<i,j<q), 

The Lie algebra m, its subalgebra (), and elements of m are given by 

m = [ n © gl n , f) = {(X,- X) G m} ~ [ n , 

E^ = (E st , 0) G m, E%> = (0, F st ) G m (1 < s, t < n). 

Set V = M„ iP (C) © M n)9 (C) and denote the linear coordinate functions on each com- 
ponent of V by i S! , y S j (1 < s < n, 1 < i < p, 1 < j < q), respectively. Put 
5 = sp 2 ( p+g )„, in which both (jj, fj) and (t, m) form dual pairs. The Weil representa- 
tion cj of 5 is realized on C[V], and its explicit forms are given as follows: 



^(ff, 



9 



n dx« ' 2 iJ ' ~ v " iJ 



E 

s=l 

n 

V 

E 



u;(F,,) 



3 = 1 



= 1 



g 

dy si 
d 



- "a 



9 



9 



(2.7) 



9 A 

2^. 
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In the similar notation to Case R, we have the decomposition of S(p) K , 

where r = min(p, q). In fact, S(p) K is isomorphic to a polynomial ring with r alge- 
braically independent generators, and their explicit forms are 

X d c = det G/j • det F J7 (d = 1, 2 . . . ,r; r = mm(p,q)). (2.8) 

Theorem 2.6. For 1 < d < mm(p,q,n), we have the Capelli identities for the 
symmetric pair of Case C. 

cWX d c ))=c(C d c ), 

where C^ G U(m) H (d = l,2,...,n) are the Capelli elements defined by sums of 
products of two d x d minors with entries in U (m) : 

C € d ={-l) d £ det(Ei:\ b + (d-b-p/2)5 Sa , tb ) a , b 

s,Tei2 (2.9) 

x det(i?S 6 + (d - b - q/2)S Sa , tb ) a , b . 
Note that the Capelli identity is trivial when n < d < min(p, q). 
Proof. As in Case R, we define the matrices 

X = (x si )i< s < nt i<i< p , Y = (y s j)l<s<n,l<j<q, 

d x = (d/cMi^M^p , d Y = (0/dy aj -)i< a <n,i<i<g ' 

and we thus have 

w(det(Gjj)) = (</=I) d ]T det %X SI ) ■ detY S j, 

seis 

;(det(F J/ )) = (V^l) d det ^ d Tj) ■ detd Ti, 



x 

'Tl 



for / G 2^, J G 2j. Using these formulas, we can prove the identity as follows: 

^( det Gjj- det F jj) = (- l) d ^ det \X SI ) det F SJ det %c%j) det fit 
iei p d ,Jei q d i, J s,Teiz 

= (-l) d detX si det • det Y~ 5J det 

= (-l) d £ W (det(^ + (d- 6-^/2)^,0^ 

xdet(^ + (d-fe- g /2)5 w J a , b ). 

The last equality follows from Lemma 2.3 by replacing k with p or q. The if-invariance 
of the Capelli element can be proved similarly to Proposition 2.5 of Case R. □ 
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2.3. Case H. For Case H, we need Lemma 2.8 on the identity of minor Pfafnans due 
to Ishikawa-Wakayama [IW]. Define complex Lie algebras 0, t and and elements 
Hij , F-ij , Gij of these algebras by 



= 2 k 



H G ' 




[f 


) 








> ~ 





H — E 

Gij = E i>k+ j — E j)k+i G p + , = .Efc+jj — G p (1 < < fc), 

where Alt^ = Altfc(C) denotes the set of the complex alternating k x k matrices. The 
complex Lie algebra m and its subalgebra f) are given by 



m = 0*2^ 



H G 
F - l H 



G,FeSjm n f- 5p 



J 2w 



We put V = M 2n ,fc(C) and denote the linear coordinate functions on V and the 
corresponding differential operators by 

x si , d si (1 < s < 2n, 1 < % < k), 

respectively. Let 5 = sp 4kn in which both (0,1)) and (6, m) form dual pairs. The 
explicit representation operators of the Weil representation u are given as follows. 

2n n 

uj(Hij) = ^2x si d sj + nSij, ^{Gij) = V^1^2(x si Xsj - XsiX sj ), 

S=1 n " k (2 ' 10) 

u(Fji) = \^1^2(d si dsj - dsid sj ), u(Est) =^x si d ti + ^5 st , 

s=l i=l 

where s = s + n. The structure of S(p) K is completely similar to Cases R and C; we 
have the decomposition of S(p) K , 

s(p) k = (w, ® c w;) K , w, ~ pi 

where fj, runs over the set of all the partitions of the form (//1, fj,i, /i 2 , 1^2, ■ ■ • ) G V k . 
The polynomial ring S(p) K has r = |_/c / 2J algebraically independent generators 

Xf= PfG 77 .PfF„ (d = l,2,...,r; r= L*/2J), (2.11) 

J tx 2d 

where Pf denotes the Pfaffian of an alternating matrix. 

Theorem 2.7. For 1 < d < min(|_/c/2j,n) ; we /iawe t/ie Capelli identities for the 
symmetric pair of Case H: 

^WX=))=c(L7 d H ), 
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where G U(m) H (d = l,2,...,n) are the Capelli elements defined by sums of 
2d x 2d minors with entries in U (m) : 

Cf= J2 det(E Sa , tb + (2d-b-k/2)S Sa , tb ) 1 < a , b < 2d , (2.12) 

where S G 2|J is defined as S = {s 1? s 2 , ■ ■ ■ ,Sd,n + Si,n + s 2 , ■ ■ ■ ,n + s d } in terms of 
So = {si, s 2 , . . . , Sd} G 2J. Note that the identity is trivial when n < d < [k/2\. 

To prove the theorem, we use the following lemma to compute Pfaffians. 

Lemma 2.8 (Ishikawa-Wakayama [IW]). Let R be a commutative ring and d < n. 
For A,B G M nM (R), X G Sym n (R), we have 

P£('^-'^)=Ew(_° x o) ss det {i) s . 

In particular, when X = I n we have 

PfCAB - l BA) = (-l)^- 1 )/ 2 det (£) , 

where S G is determined by S as in Theorem 2. 7. 

Proof. The first formula is due to Ishikawa-Wakayama [IW, Corollary 2.1]. For the 
second formula we use two facts. The condition Pf ( ^ 7 q ) ^ implies Sd +i = 
n + Si (1 < % < d), and that Pf ( _° Id ^) = (-l)^ 1 )/ 2 . These facts give the second 
formula. □ 



Proof of Theorem 2. 7. Define matrices by 

X = (:£si)l<s<n,l<i<fc, X = (Xsi)l< s <n,l<i<k, 

9 = (d s i)±< s < nt i<i<k, d = (dsi)l< s <n,l<i<k- 

Then we have the equations of matrices 

oj(G h ) = V^l(XX 9j )X.j - XX.j)X.,j), 
u(F n ) = -V^l(\d.j)d.j - Xd).jd.j), 

for / G T 2d . Using these equations we prove the identity as follows: 

r ii) 



E Pi (Xx.,i)x. :I - Xx.^x.j) ■ Pi(Xd.j)d.,j - Xd.,i)d.,j) 

liz - L 2d 

E E (-i)*-"'Met (£) . £ (-d*-w, det (£) 



(by Lemma 2.8) 
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= S u ( det (^.*i> + (2^ - & - ^/2)5 Sa) t 6 )i< a , 6 <2d) • (by Lemma 2.3) 

s ,T ei2 

The if-invariance of Cjf can be shown similarly as in the proof of Proposition 2.5, 
which we omit. □ 

3. The intersection of harmonics 

3.1. Diamond pair. The three see-saw pairs considered above is a part of the dia- 
mond pair listed below. 

U2n Ufc ; jfc 
/ \ / \ 

USp 2n 2n (M) <=► Sp 2k (R) 0* k (3.1) 

\ / \ / 

u„ u fe 

Note that, in the diagram, each pair which is connected by line is a symmetric pair. 
We give the explicit realization of each group here because the realization itself is 
important in the sequel. 

U 2ra = {<? G GL 2n (C) | t g = g~ 1 } 
USp 2n = {ge U 2n | l gJ n g = J n }, J n = 
2n (R) = {ge GL 2 „(R) | *g = g' 1 } = U 2 „ n GL 2ri 



U n = USp 2n n 2n ( 
Note that the unitary group U n above is not realized in the standard form. 

Ufc,fc = {g e GL 2fc (C) | = 4, fc }, = diag (l fc , -l fc ) 

s P2fc( R ) = {9 e U fejfc I *5 Jfc^f = J fc } 

u fe = s P2fc (M) n 04 

These are almost standard realizations except in the bottom. For Sp 2fc (R), see 
[Kna, § VII. 10, Problem 30]. In the book [Kna, §1.17, Eq. (1.141)], 0* 2k is defined 
precisely as here. Also refer [Kna, § VII. 10, Problems 32 & 35] for U^. 

In the following, we complexified the compact subgroups (the left hand side of the 
diamond pair) and consider the complex groups GL 2n , Sp 2n , 2n and GL n . 

3.2. A problem. Consider an irreducible finite dimensional representation p 2n of 
GL 2n with the highest weight A G Vm- Let B 2n = A 2n N 2n be the standard Borel 
subgroup of upper triangular matrices in GL 2n , where A 2n is the diagonal torus and 
N 2n is the maximal unipotent subgroup consisting of all the upper triangular matrices 
with l's on the diagonal. We take a nonzero highest weight vector v\ in p 2n with 
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respect to B 2n . Let 2n (respectively Sp 2n ) be the orthogonal group (respectively 
symplectic group) realized as a subgroup of GL 2n as above. Let us consider 



U\ = irreducible 2n submodule in p\ n generated by v\, 
V\ = irreducible Sp 2n submodule in p\ n generated by v\. 



Here, if A is a partition of length < n, we have isomorphisms U\ = <r 2n and V\ = r 2n . 

Note that 2n fl Sp 2n = GL„ (see Equation (3.3) below). We shall denote this 
explicitly realized subgroup of GL 2n again by GL n . Note that the intersection U\C\V\ 
is a GL„ module. We shall study the following problems. 

(i) What is the GL n module structure of U\ fl V\! 

(ii) What are the GL n highest weight vectors in U\ fl V\? 

(iii) How to characterize the subspace U\ fl V\ inside the representation of GL 2n ? 

The problems (i) and (ii) are closely related to the theory of joint harmonics, and we 
will give a satisfactory answer to these problems. On the other hand, the problem 
(iii) seems to be related to the Capelli elements for symmetric pairs. For this, we do 
not have a complete answer yet, but we will prove that the subspace U\ fl V\ is in a 
joint eigenspace of the Capelli elements. 

3.3. The intersection of harmonics. From now on, we assume n > k throughout 
the rest of this section. 

Choose a joint complete polarization of C 2n with respect to the standard symmetric 
and symplectic bilinear forms. So we have C 2n = L + © L~ , where iJ* 1 is a maximal 
totally isotropic space for the both bilinear forms. If we choose a basis of L + and 
then L~ , then they together form a basis for C 2 ™. We can assume that 2ri is the 
subgroup of GL 2 „ which preserves the symmetric bilinear form 

n 

((x 1 ,...,x n ,y 1 ,...,y n ), (x' 1 ,...,x' n ,y' 1 ,...,y' n )) = ^ !•'•,//' • //,.'•') 

3=1 

in the coordinate of C 2n with respect to the basis specified above. Also Sp 2n is the 
isometry group of the symplectic form (., .) on C 2n given by 

n 

({x u ...,x n ,y u ...,y n ),{x[, ...,x' n ,y[, ...,y' n )) = ^ (.'•,//' // r r' ) 

3=1 

with respect to the same coordinate of C 2n . In the following, we fix this specific basis 
and use the coordinate expression freely. Then, in matrix form, the intersection of 
2 „ and Sp 2n is given by 

2 „ n S P2n = I (J t g-,y. ge GL„| , (3.3) 

which we will denote simply by GL„. Let M 2njfc = M 2 „ ife (C) be the space of 2n x k 
complex matrices, and let 

^ ^ 2n . fe ' X = ( x ij)l<i<n,l<j<k, Y = (yij)l<i<n,l<j<k 
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be the system of standard coordinates on M 2 „ ifc . For 1 < i, j < n, put 

ij ~ 2-? dx ai dy aj ' ) A s P A A ! ' 

a=l J \ tj % 3 J 1 ' 

Notice that the Laplace operators above coincide with a;(Fj 3 -)'s in Equations (2.1), 
(2.7) and (2.10) up to constant multiple. We now define the following spaces of 
harmonic polynomials: 



H(GL n ) = {feC[M 2n<k } 
H{0 2n ) = {/eC[M 2n , fc ] 
^(Sp 2n ) = {feC[M 2nik } 



A ij (/) = 0Vl<i,j<n}, 



Ag(/) = 0Vl<i,j<n}, 
A*(/)=0Vl<i,j<n}. 



It is clear from the definitions that H(GL n ) = H(0 2n ) fl 7i(Sp 2n ). 
Let GL 2n X GL fe act on M 2rijfc by 

(<?, h).T = l g- 1 -T-h- 1 ; (g, h) G GL 2n x GL fc , T G M 2n , fe . 

This action induces an action of GL 2 „ x GL k on the algebra C[M 2n ^] of polynomial 
functions on M 2n fe . By the (GL 2n , GL fc )-duality, we have 

C[M 2 „ ifc ] = A ^ n ® p£. 

Let B k = A k N k be the standard Borel subgroup of upper triangular matrices in GL k 
similarly defined as B 2n C GL 2n . By taking iV^-invariants, we obtain 

Note that C[M 2n:k ] Nk is a module for GL 2n x A k . Let W\ denote the the submodule 
PL ® (Pk) Nk of <E[M-2n,k] Nk ■ We denote by ip k the character of A k defined by 

i> k (a) = a x = a^ 1 ■ ■ ■ a\ k (a = diag (ai, . . . , a k ) G A k ). 

Then W\ is the ^-eigenspace for A k in C[M 2rij fc]. Since dim(p^) Arfe = 1, if we ignore 
the action of A k and consider only the action of GL 2n on W\, then W\ is a copy of 
the representation p 2n . 

We now let £\ be a GL 2n x GL fc joint highest weight vector in C[M 2njfc ] of weight 
ip 2n x ipj! (which is unique up to scalar multiples). Then £ A is a GL 2n highest weight 
vector in W\. Now 2n and Sp 2n act on C[M 2ni fc] as subgroups of GL 2n . In this 
realization, we can identify the subspaces U\ and V\ in Equation (3.2) with 

U X = irreducible 2 „ submodule in p\ n generated by 
V\ = irreducible Sp 2n submodule in p 2n generated by £a- 

The space Tt(0 2n ) of 2n harmonic polynomials is a module for 2n x GLfc with 
its structure given by 

n(o 2n ) - < ® pi 
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In addition, the joint 2n x GL fc highest weight vector in a 2n ® Pk coincides with the 
GL 2n x GLfc highest weight vector in p% n <g> p%. By taking N k invariants, we obtain 

n(o 2n ) N * - < ® (p») N » 

which is now a module for 2n x A k . From here, we see that the subspace U\ coincides 
with the submodule u\ n ® (Pk) Nk of 7i(0 2n ), and it is precisely the ^-eigenspace 
n(0 2 n) N x of A k in ft(0 2n )^. On the other hand, the space H(Sp 2n ) is a module for 
Sp 2n x with its structure given by 



Men 



'2n 



In a similar way as the 2n harmonics, the subspace V\ is the ^-eigenspace 7i(Sp 2n 



of A k in 7i(Sp 



2n) 



Consequently, 



u x nv x = H(0 2n ) N ^nH(Sp 2n y;t 



(3.5) 



Next we consider the space 7Y(GL n ) of GL„ harmonics. It is a GL n x GL fc module. Let 
H(GL n )^ denotes the ^-eigenspace of A k in the space H(GL n ) Nk of N k invariants 
in H(GLn). Then since H(GL n ) = H(0 2n ) n ft(Sp 2n ), 



H(GL n )»l = H(0 
It follows from this and Equation (3.5), 



2nJ 



C/a n Va = H(GL n 



(3.6) 



3.4. Decomposition of £/a fl Va as a GL„-module. We now determine the GL n 
module structure of H(GL n )^. Put V( k ,n) = {{p^) & V k x V k \ £(p) + t{y) < n}. 
Then, under the action of GL„ x GL k , the GL n harmonics decomposes as follows. 



W(GL„) 



e 



(k,n) 



[© 



®^)6P(,,„) C ^ P; ' 



-.V 



Pk 



®pI 



In the above formula, we use the Littlewood- Richardson rule and denotes the 
Littlewood-Richardson coefficient which counts the number of the Littlewood-Rich- 
ardson tableaux of shape rj/p and content v (see [Ful]). By taking Nk invariants, we 
obtain 

It follows that under GL„, 



(fe,n) 



®(PI) 



V\N k 



(3.7) 



w(gl b )$ = 



e 



0^)e7>(fc,n) 



A U©J/ 



Thus we have proved: 
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Theorem 3.1. Assume that k < n, and take A G Vk- We define the subspaces 
U\ ~ a\ n and V\ ~ r 2n m p^n as ^ n Equation (3.2). T/ien we have a decomposition 
under the action of GL n; 

where the summation is taken over the pair (/i, v) such that + t{y) < n. 

3.5. Annihilator of Capelli elements. In this subsection, we clarify the relation 
between the intersection of harmonics and Capelli elements which we have constructed 
in § 2. 

Since the harmonics is by definition annihilated by the (generalized) Laplace op- 
erators (3.4), and those Laplace operators are precisely those u^-F^'s, we conclude 
that they are annihilated by the Capelli elements co(L(Xf)) = u(Cf). Here, the 
symbol K stands for R, C or K respectively. Note that Cf's (K = R,C,H) all 
belong to the enveloping algebra U(Qi n ). Thus, the intersection of the harmonics 
7i(GL„) = 7i(0 2n ) H Ti(Sp 2n ) are annihilated by all the operators {Cf | 1 < d < 
r K ; K = R, C, H}, where r K = k for K = R, C and r H = [k/2\ . 

However, note that co(Cf) does not coincide with the above action of GL 2 „ on 
C[M 2nj fc] arisen by the left multiplication. Instead, it differs by the character (of the 
two fold covering group) of GL 2n which originates from the definition of the Weil 
representation. In the present situation, the character is Xk = det fe ^ 2 whose highest 
weight is dxfc = (A;/2)(l,l,...,l). 

Proposition 3.2. Assume that k <n, and let U\ and V\ be as in Theorem 3.1. Then 
the Capelli elements annihilate U\ fl V\ up to the shift of the central character Xk- 
Namely we have 

Cf(U x D V x ) = 0, where Cf = d(p x 2n ® X k)(Cf) (1 < d < r K ; K = R, C, H). 
Here, dp stands for the differentiated representation of gl 2n . 

It is interesting to study the kernel f] dK Kei in the representation space of p 2n . 
However, up to now, no complete characterization is known. 

4. The GL k tensor product algebra 

In this section, we assume that 2k < n, which is stronger than the one in § 3. Under 
the assumption, we shall prove that the space Ti,(GL n ) NnXNk of N n x iVVinvariants 
in 7i(GL n ) is an algebra isomorphic to the GL fc tensor product algebra constructed 
in [HTW]. Using their results, one can obtain a basis for H(GL n ) NnXNk . 

By taking ^-invariants in Equation (3.7), we obtain 

n{GLn) N n ,N k ^ C \ v [(pfT" ® U) Nh ] ■ (4-1) 

Let H M: x be the ^ v x ^-eigenspace for A n x A k in H(GL n ) N " xNk . Then 
and by Equation (4.1), dim H M ,\ = cJ )V . 
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For convenience, we shall replace the coordinates Y = (y^) by Y = (y^), where 

jjij = y n -i+i,j, (l<i<n, l<j<k). 

We now let 2lx, 2ly and 21 be the subalgebras of C[M 2n ,fe] generated by the following 
coordinates: 

2l x = C[ Xij : l<i,j <k]= C[M fc ] 

2ly = C[y^-: l<2,j<A;] = C[M fc ] 

21 = C[xy, y^- : I < i,j < k] = %l x <S> 2ly = C[M fc ] <g> C[M fc ], 

where M fc = M fc (C) is the space of k x complex matrices. By examining the 
definition of H(GL n ), we note that 

Observation 4.1. TTie algebra 21 is contained in the space H(GL n ) of GL n harmon- 
ics. 

Now two copies of GLfc are acting on Mfc: one by left multiplication and the other 
by right multiplication. Specifically, for (g, h) G GLfc x GLfc and T G Mfc, 

(g,h).T= tg-'-T-h' 1 . 

We shall distinguish these two copies of GLfc by writing them as L(GLfc) and R(GL k ) 
respectively. More generally, if H is a subgroup of GLfc, we shall write the correspond- 
ing subgroups of L(GLfc) and R(GL k ) as L(H) and R(H) respectively. In particular, 
L(iVfc) is the maximal unipotent subgroup of L(GLfc). 

Lemma 4.2. We have the isomorphism 

H(GL n ) Nn Qi L x (Nk) ® 2l y (7Vfe) . 

In particular, 7i(GL n ) Nn is a subalgebra of C[M 2n ,k]- 

In fact, 

^(GL n )^ = (fC T n ® P" k ® Pi (4-3) 
vj -' [1,1/ 

as an A n x GLfc x GLfc module. In particular, the isotypic component {Pn &u ) Nn <S> p k ® P k 
can be characterized as the ^ ^-eigenspace for A n in H(GL n ) Nn . We shall first 
describe a spanning set for this isotypic component. 

For 1 < j < k and / = {ii, ■ ■ ■ G X™ where 1 < i± < • ■ ■ < ij < n, let 

=detX J7 , where J = {1,2,..., j'} and X = (x S)i )i< s < nj i< t <fc, 
rjj(I) = det Y} 7 , where J = {1,2, . . . , j} and Y = (y s ,t)i<s<n,i<t<k- 

We also write 

7j = 7j({l,2,...,j})> and ^ = ^({1, 2, j}). 
For /i = (/ii, ...,/ifc) G Pfc and v = {v u v k ) G P fc , define 

a 3=Pj-l-Pj, b 3=Vj-l-Vj fOTl<j <k-l, , 44 , 

afc = hh, b k = v k . 

Then = 7i 1 7 2 12 • • • l k k Vi 1 V2 i ' ' ' Vk* lfi ^ ne unique (up to scalar multiple) GL n x 
GLfc x GLfc highest weight vector in H(GL n ) of weight ^ Qiy x x if>%. 



HARMONICS AND CAPELLI IDENTITIES 19 
Lemma 4.3. For /i, v e Vk, the set of polynomials of the form 

ft M^P' ft [VmiJm)}^ (4.5) 
j=l m=l 

spans the isotypic component (Pn Gu ) Nn <8> Pk ® Pk ^ n W(GL n ). i/ere ij G and 
J m £ Z^ are subsets of {1, 2, fc} with j and m elements respectively, and aj and 
b rn are given in Equation (4.4) 

Proof. First we note that all elements of the form (4.5) are GL„ highest weight vectors 
of weight il>n &u ■ Let be the subspace of 7i(GL n ) spanned by them. Then W is 
contained in the isotypic component (Pn &u ) Nn <8> Pk® Pk m ^(GL n ). 

On the other hand, we note that the operators which arise from the infinitesimal 
action of GL fc x GL fc are derivations and affect only the second index j of the variables 
Xij and yij. Thus W is invariant under GL^ x GL&. Since the space (Pn Gl/ ) Nn <8> p^® p u k 
is an irreducible GL fe x GL fc module, we have W = (p% Qu ) Nn <S> p^ <8> p v k - □ 

Corollary 4.4. Assume that 2k < n. Then the space H(GL n ) Nn is the subalgebra 
of C[M.2n,k] generated by all polynomials of the form "fj(Ij) and r) m (J m ), where 1 < 
j,m < k and Ij and J m are subsets of {1, 2, . . . , k} with j andm elements respectively. 

Proof of Lemma 4-2. By similar reasonings as Lemma 4.3 (see [How3, p. 83]), the 
algebra 31^^ is generated by the polynomials 'jj(Ij) where 1 < j < k and Ij C 
{1, . . . , k} has j elements. Similarly Sly ^ is generated by r] m (J m ) where 1 < m < k 
and J m C {1, . . . , k} has m elements. It follows that the algebra Sl^^ <8> Sly Nk ^ and 
H{G\j n ) Nn have the same generators. Hence they are isomorphic. □ 

The GL fc tensor product algebra is defined as 

TA fc := [qM/WgClM,]*']^' 1 

in [HTW]. A basis for this algebra was also given in the same paper. 

Corollary 4.5. Under the assumption 2k < n, we have the isomorphism 

H(GL n ) NnXNk = [^ Nk) ®^ Nk) ] A(R{Nk)) . 

In particular, Ti(GL n ) NnXNk is isomorphic to the GL k tensor product algebra TA^. 

Note that by switching the roles of L(GL^) and R(GLk) in TA&, we obtain the 
algebra in H(GL n ) N " xNk . It follows that to construct a basis for H(GL n ) NnXNk , we 
only need to take the basis constructed in [HTW] and replace their coordinates by 
ours. We leave the details to the interested readers. 
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